On Markov chains induced by partitioned transition probability matrices
نویسندگان
چکیده
منابع مشابه
Transition Effect Matrices and Quantum Markov Chains
A transition effect matrix (TEM) is a quantum generalization of a classical stochastic matrix. By employing a TEM we obtain a quantum generalization of a classical Markov chain. We first discuss state and operator dynamics for a quantum Markov chain. We then consider various types of TEMs and vector states. In particular, we study invariant, equilibrium and singular vector states and investigat...
متن کاملApproximations for Markov Chains with Upper Hessenberg Transition Matrices
Abstract We present an approximation for the stationary distribution T of a countably infinite-state Markov chain with transition probability matrix P = (pq) of upper Hessenberg form. Our approximation makes use of an associated upper Hessenberg matrix which is spatially homogeneous one P ( ~ ) except for a finite number of rows obtained by letting p q = pj-i+l, i > N + 1, for some distribution...
متن کاملFinding Generators for Markov Chains via Empirical Transition Matrices
In this paper we identify conditions under which a true generator does or does not exist for an empirically observed Markov transition matrix. We show how to search for valid generators and choose the \correct" one that is the most compatible with bond rating behaviors. We also show how to obtain an approximate generator when a true generator does not exist.
متن کاملStationary Probabilities of Markov Chains with Upper Hessenberg Transition Matrices
In this paper, based on probabilistic arguments, we obtain an explicit solution of the stationary distribution for a discrete time Markov chain with an upper Hessenberg time stationary transition probability matrix. Our solution then leads to a numerically stable and efficient algorithm for computing stationary probabilities. Two other expressions for the stationary distribution are also derive...
متن کاملar X iv : 0 90 7 . 45 02 v 1 [ m at h . PR ] 2 6 Ju l 2 00 9 On Markov chains induced by partitioned transition probability matrices
Let S be a denumerable state space and let P be a transition probability matrix on S. If a denumerable set M of nonnegative matrices is such that the sum of the matrices is equal to P , then we call M a partition of P . Let K denote the set of probability vectors on S. To every partition M of P we can associate a transition probability function PM on K defined in such a way that if p ∈ K and M ...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Acta Mathematica Sinica, English Series
سال: 2010
ISSN: 1439-8516,1439-7617
DOI: 10.1007/s10114-010-9696-9